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Abstract 

We  introduce  new  penalties,  called  valid  integer  polytope  (VIP)  penalties,  that  tighten  the  bound  of  an  integer-linear 
program  during  branch-and-bound  enumeration.  Early  commercial  codes  for  branch  and  bound  commonly  employed  penal¬ 
ties  developed  from  the  dual  simplicial  lower  bound  on  the  cost  of  restricting  fractional  integer  variables  to  proximate 
integral  values.  VIP  penalties  extend  and  tighten  these  for  ubiquitous  A:-pack,  A^-partition,  and  A^-cover  constraints.  In 
real-world  problems,  VIP  penalties  occasionally  tighten  the  bound  by  more  than  an  order  of  magnitude,  but  they  usually 
offer  small  bound  improvement.  Their  ease  of  implementation,  speed  of  execution,  and  occasional,  overwhelming  success 
make  them  an  attractive  addition  during  branch-and-bound  enumeration.  ©  2000  Elsevier  Science  B.V.  All  rights  reserved. 
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1.  Preliminaries 

The  integer  linear  program  (ILP)  is  defined  here  as 


minimize  cx 

subject  to  Ax  —  h,  x  ^  0, 

(1) 

x,  G{o,i}  yjcR, 

(BINARY) 

where  c  and  x  are  «-vectors,  h  is  an  tw-vector,  ^  is  an  nt  x  «-matrix,  and  R  is  an  index  set  of  binary  variables. 
Let  X  be  an  admissible  incumbent  solution  to  ILP,  i.e.,  x  satisfies  (1)  and  (BINARY),  and  let  r(x)  =  cx. 
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Define  the  continuous  relaxation  of  ILP  as 
LP  minimize  cx 

subject  to  Ax  =  h,  x^O, 

Xj  G  [0, 1]  vy  G  R,  (CSR) 

where  (CSR)  is  the  continuous  simplicial  relaxation  of  (BINARY).  Let  x  be  optimal  to  LP.  Thus,  v{x)  = 
cx^v(x).  Solving  LP  using  the  simplex  method,  we  obtain  x  and  a  revised  representation  of  LP  in  nonbasic 
variable  space: 

LPN  minimize  v{x)  +  E  CjXj 

jGN 

subject  to  Xi  =  Xi  —  ^  dijXj  Vi  ^  N, 

JGN 

Xj>o  yj, 
x,  G[o,i]  yjeR, 

where  N  is  the  index  set  of  nonbasic  variables,  dij  is  the  coefficient  of  nonbasic  variable  Xj  in  the  representation 
of  basic  variable  x,,  and  Cj  is  the  reduced  cost  of  nonbasic  variable  Xj. 

For  solution  x  to  LP,  define  F  as  the  index  set  of  variables  fractional  in  LP  and  restricted  by  (BINARY) 
in  ILP:  F  =  {j  &  R:  xj  G  (0, 1)}.  If  LP  yields  a  solution  with  0  <  f y  <  1  for  some  j  (i.e.,  F  ^  0),  we  can  use 
a  simplicial  restriction  to  try  to  improve  our  lower  bound  on  v{x)  by  restricting  Xj  to  a  binary  value.  Define 
such  a  simplicial  restriction  for  j  G  R: 

LPX((5y)  minimize  cx 

subject  to  Ax  —  h,  x^O, 

XyvG[0,l]  V/gR\{7}, 

Xj  =  Sj, 

where  Sj  G  {0,1}.  Thus,  r(f )^min{r(i|(5y  =  0),  r(i|(5y  =  1)} ^r(x)  where  i|(5y  indicates  an  optimal  solution 
to  LPX(<5y). 

Branch-and-bound  enumeration  employs  restrictions  of  this  sort  to  find  admissible  ILP  solutions,  or  to 
establish  an  improved  lower  bound  on  the  solutions  to  ILP  that  might  be  achieved  via  further  restrictions.  If 
such  a  lower  bound  is  known  to  apply  to  all  such  restrictions,  it  improves  the  lower  bound  on  the  best-known 
incumbent  solution  to  ILP. 

Before  solving  LPX((5y  ),  we  can  use  remnants  of  the  simplicial  solution  of  LP  to  conservatively  forecast 
the  penalty  of  the  LPX((5y  )  restriction  (e.g.,  [4,10]).  This  forecast  improves  the  lower  bound  on  the  best  new 
incumbent  we  might  find  by  solving  LPX((5y  ),  or  any  additional  restrictions  beyond  those  of  LPX((5y  ). 

Because  solving  problems  like  LPX(<5y  )  can  be  difficult,  and  because  there  can  be  many  to  solve,  prior 
bounds  on  such  solutions  can  be  of  considerable  value  to  the  overall  success  of  branch  and  boimd.  This  helps 
motivate  the  early  use  of  penalties  constmcted  from  remnanfs  of  the  simplicial  solution.  But,  as  Nemhauser 
and  Wolsey  [6,  p.  360]  state  in  the  context  of  branch  selection 

They  [Penalties]  were  used  in  early  commercial  codes  but  are  not  in  favor  now  because  they  are  too  costly 
to  compute  relative  to  the  value  of  the  information  they  give. 

While  we  do  not  disagree  that  exact  penalties  serve  as  a  poor  criterion  for  branch  choice,  we  contend  that  exact 
penalties  can  be  valuable  for  improving  lower  bounds  for  difficult  ILPs,  and  conjecture  that  some  commercial 
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codes  do  employ  penalties  to  improve  lower  bounds  on  incumbent  solutions.  We  lament  that  such  details  are 
proprietary  secrets  for  most  current  commercial  codes.  We  show  that  these  penalties  can  be  specialized  and 
strengthened  in  the  presence  of  A: -pack,  k-cover,  and  A: -partition  constraints,  and  are  not  costly  to  compute 
relative  to  their  occasional  stunning  bound  improvements. 


2.  VIP  penalties  for  k-pack,  k-cover,  and  A:-partition 


Define  =  0)  — r(jc))  as  the  “simplicial  down-penalty”  associated  with  J  G  R  and  6/  (6j^v(x\Sj 

=  1)  —  v{x))  as  the  “simplicial  up-penalty”.  These  “up  and  down”  penalties  derive  from  the  simplicial  rep¬ 
resentation  of  a  solution  to  LP,  and  are  readily  computable  from  computational  remnants  of  that  solution. 
Tomlin  [10]  calculates  these  penalties  for  i  G  R  as 


0.  =  0  for  Xi  =  0, 


if  j 

>  for  0  <  Xi  ^  1, 

if  j^R 


Oi  =  Ci  for  i  G  N,  9i  =  min 

jGN,dij<0 


if  j 

>  for  i  ^  N,  <  1, 

if  j  ^  R, 


and  0i  =  0  for  f,  =  1. 

A  valid-integer-polytope  (VIP)  constraint  is  a  valid  inequality  on  the  ILP  integer  polytope.  The  VIP  con¬ 
straints  O^xy^l  for  j  G  R  improve  v(x)  by  min{0y,  0,}  (e.g.,  see  [4,  p.  120]).  Because  each  variable  j  GF 
must  be  restricted  to  zero  or  one  to  satisfy  (BINARY)  in  ILP,  the  collective  improvement  is 

0(CSR)  =  max{min{0  , 9;}}  =  max{min{0 -,  0,}}.  (2) 

id?  J  C  /P 


We  strengthen  the  penalty  offered  by  (2)  for  A: -pack,  A:-cover,  and  A:-partition  constraints  (original  ILP 
constraints  or  valid  inequalities  to  ILP).  Tomlin  [10]  also  strengthens  the  penalty  offered  by  (2);  he  presents 
penalties  deduced  from  the  observation  that  the  fractional  source  variable  in  a  Gomory  cut  induces  movement 
in  the  other  variables  from  which  a  penalty  can  be  derived  (e.g.,  [7,  pp.  192-193]).  Because  our  development 
requires  that  we  associate  specific  up  and  down  penalties  with  particular  variables,  we  cannot  apply  this 
result. 

To  motivate  our  development,  we  start  with  a  simple  pairwise  1-pack  VIP  constraint: 

Xj+Xj>^\,  {J,/}=R'  <GR. 


Here,  we  see  that  either  x,  or  xf  must  be  restricted  to  zero  in  ILP.  Thus,  we  know  besides  the  contribution  of 
these  two  variables  to  0(CSR),  the  smaller  of  their  two  down  penalties  (min{0y,  0y,})  also  applies.  Combined 
with  (2),  we  obtain 

max{min{0y,  0y,},max{min{0y,  0y},min{0y,,  0,/}}}. 


(3) 
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To  generalize  this  observation,  define  ([/]„)  as  the  index  j  e  R'  (f  G  R')  corresponding  to  the  /th  as¬ 
cending  down-penalty  (ascending  up-penalty)  in  the  set  R'  C  R_  and  let  That  is,  «'={[l]d,  [2]d,  -  -  - ,  [r'Jd} 

=  {[l]y,[2]^, ...,[r']^}  where  ^  and  ^  Also  define  the  ordered 

subsets  of  R',  Rl  =  {[IJd,  [2]d,  -  -  Wdl'and  R^  =  {[1]„,  [2]„, .  ^ ,  W  J. 

Using  this  notation,  we  know  and  ^min{0[[]^,  so  (3)  becomes 

max{fi[i]^,min{0p]^,0[2]J}. 


Property  1.  A  general  A: -pack  VIP  constraint  with  r'  >  k: 
Xj  ^  k,  (A: -pack ) 

j&R' 

offers  improvement  of  v(x)  by 


fi(A:-pack)  =  max 


,  ,  max 

I  ■'  '  (--'-Od 


{min{0,,fi;}} 


(4) 


Proof.  The  term  arises  from  the  V  —  k  variables  in  set  R'  that  must  have  value  zero  in  ILP.  The  latter 

term  derives  from  (2)  and  the  result  that 

{min{0^-,0y}}.  □ 

Property  2.  A  A:-cover  VIP  constraint  with  r'  >  k\ 

Xj  ^  k,  ( A:-cover ) 

j&R' 

offers  improvement  of  v(x)  by 

fi(A:-cover)  =  max  <  9[k]  ,  max  {min{0 , 0y}}  >  .  (5) 

I  “  1 


Proof.  The  term  0[k]  is  justified  because  at  least  k  variables  in  set  R'  must  have  value  one  in  ILP.  The  latter 
term  derives  from  (2)  and  the  result  that 

^[k]  ^  max{min{0  -,  0y}}.  □ 

Property  3.  A  A:-partition  VIP  constraint  with  r'  >  k: 

Xj  =  k,  (A: -partition) 

j&R' 

offers  improvement  to  v(x)  by  the  maximum  of  the  Ar-pack  and  Ar-cover  VIP  penalties'. 

fi(A: -partition)  =  max{0(A:-pack),  0(A:-cover)}.  (6) 


3.  Pack  and  cover  symmetry 

There  is  a  symmetry  between  the  pack  and  cover  VIP  constraints  and  the  associated  VIP  penalties  presented 
here.  Consider  the  A:-pack  constraint  xj^k  and  let  xj  =  1  —  x'  (a  complement  reflection)  Vj  G  R' . 
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Then 


((A:-pack)  in  a:)  ^  Xj^k  Ed  —  Xj)^k  x'j^r'  —  k  ({r'  —  k-cover)  in  x' ). 

jeR'  jeR'  jeR' 

Because  Oj  =  Oj,  and  Oj  =  0'^,  the  VIP  penalty  for  the  A: -pack  is  identical  to  that  of  the  complement  r'  — k-cover: 


0(k-pack)  =  max  <  max  {min{d^,  Oj}}  >  , 

I  J 


6{r'  —  k-cover)  =  max  <  ,  max  {min{0',  d^}} 


jeR'\R' , 


4.  When  VIP  d(k-pack)  and  0(k-cover)  can  be  stronger  than  0(CSR) 

The  following  establishes  necessary  conditions  for  which  the  VIP  penalties  d(k-pack)  or  0(k-cover)  can  be 
stronger  than  the  conventional  0(CSR)  penalty. 

Define  R'  =  {j  G  R'\  xj  =  0}(R  =  {j  €  R':  Xj  =  1})  as  the  set  of  variables  restricted  (Binary)  in  ILP  and 

equal  to  zero  (one)  in  LP.  Also  define  F'  =  {j  G  R':  xj  G  (0, 1)},  /  =  |R'|,  r  =  |R^|,  and  /'  =  |T’'|.  (Note: 

R'  =R'UR'  U  F'  and  r'  =  F  +F  +  /'.) 

Clearly,  if  T’'  =  0  then  0(CSR)  =  0(k-pack)  =  0(k-cover)  =  0  in  (2),  (4),  and  (5)  (i.e.,  the  bounds  provided 
by  (2),  (4),  and  (5)  can  be  nonzero  only  when  /'^l). 

From  the  definition  of  R',  R  ,  d^r'-k]  >  it  follows  that  the  value  of  0(k-pack)  (0(k-cover))  can 

exceed  the  value  of  0(CSR)  only  if  r' —  (k  -f  1)  in  k-pack  (r'^k  —  1  in  k-cover). 

Property  4.  The  relationship  between  F,r',  and  /'. 

•  F  ^r'  —  (k  +  \  )  in  k-pack  (r'  ^k  —  1  in  k-cover)  implies  f 

Proof.  F  =  F  +  r'  +  f  or  f  =  r'  —  F  —  r'  and  r'  ^k  in  k-pack  (F  ^r'  —  k  in  k-cover)  providing  f  — 

F  -{k+  1)  -  k{  f  ^F  -  (F  -  k)  -  {k  -  1))  or  />1.  □ 

•  ^  1  does  not  necessarily  imply  /  —  (k  +  1 )  in  k-pack  (r'  ^k—  1  in  k-cover)  when  k  ^2  (k^F  —  2). 

For  example,  x\+X2+x^^2  with  x\  =0,  fa  =  ^3  =  0-5  provides  r'  =  1  and  f  =  2  (xi  -h xa  -t- X3 ^  1  with 
f  1  =  1,  fa  =  fa  =  0.5  provides  r '  =  1  and  /'  =  2). 

•  When  k^l  {k^F  —  1),/'  >  1  implies  — (k-f  1)  (r' ^k  —  1)  in  k-pack  (k-cover). 

Proof.  For  k-pack,  assume  F  >  r'  —  (k  +  l)^F  —  2  or  2  >  F  —  F  implying  (since  f'  =  F—F  —  r')  the 
contradiction  ^  1.  For  k-cover,  assume  r'  >k— l^F  — 2  or  2  >  F  —  r'  implying,  again,  the  contradiction 

□ 

It  is  therefore  necessary  for  r' —  (k  -f  1)  in  k-pack  (f'^k  —  1  in  k-cover)  for  the  value  of  0(k-pack) 
(0(k-cover))  to  exceed  the  value  of  0(CSR).  When  /'  >  1  this  necessary  condition  is  satisfied  for  k^l  in 
k-pack  (k^F  —  I  in  k-cover)  but  not  for  arbitrary  k. 
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5.  VIP  opportunities  abound  in  real-world  models 

Pack,  cover,  and  partition  constraints  aboimd  in  real-world  models.  Generalized  upper  boimd  (GUB)  con¬ 
straints  [3]  are  often  present  in  large  numbers  (see  e.g.  [1]  and  references  therein).  We  submit  that  GUB 
constraints  often  apply  to  sets  of  binary  variables,  and  that  the  coefficients  of  these  constraints  are  often  one, 
or  can  be  rendered  so  by  scaling  and  reflection.  Other  row-factorizations  (e.g.,  pure  network  rows)  also  exhibit 
such  structure.  Furthermore,  the  right-hand  side  of  such  integer  forms  can  he  tightened  to  some  integer  k  after 
scaling  and  reflection  of  row  coefficients.  The  most  frequent  value  of  k  is  one. 

A  special  ordered  set  (SOS)  constraint  of  Type  i  [9]  is  a  1-pack  constraint,  Tomlin  suggests 

branching  by  partitioning  the  variables  in  R'  into  two  subsets,  each  of  which  is  alternately  forced  to  zero, 
inducing  a  0-pack  constraint  ^0  for  R\  cR'). 

Both  GUB  and  SOS  constraints  are  potential  sources  for  ViP  penalties  when  their  incident  binary  variables 
are  fractional. 

A  “simple  variable  upper  boimd  constrainf’  or  “SVUB  constraint”  has  the  form 
{j,j'}CR,  (SVUB) 

and  is  a  simple  example  of  a  variable  upper  bound  [8].  SVUB  can  be  used  to  control  binary  xj  with  binary 
Xj'\  “j  only  if  f.”  Such  constraints  occur  frequently,  and  when  a  model  exhibits  SVUBs,  it  often  contains 
many  of  them. 

Proposition  5.  Using  the  SVUB  constraint,  v(x)  may  be  improved  by 

0(SVUB)  =  min{max{0y,0y/},max{0y',min{dy,0y}}}.  (7) 

Proof.  If  Xj!  =0  then  Xj  —  O  and  max{0y,0y, }  is  a  valid  bound.  If  xy  =  I  then  Xj  =  0  or  I  and  max{0y/, 
minjdy,  0;}}  is  a  valid  bound.  Because  xy  may  take  on  the  value  zero  or  one,  we  must  take  the  minimum  of 
these  two  bounds.  □ 

Although  not  immediately  obvious,  (7)  is  equivalent  to  the  result  obtained  when  a  SVUB  constraint  is 
transformed  to  an  equivalent  1-pack  constraint  by  complementing  xy\ 

Xj  ^xy  Xy  ^  1  —  Xy  Xj  -F  Xy  ^  1, 

providing  under  (4) 

max{min{0y,(ly,  =  0y/},max{min{0y,0y},min{0y,,0y/}}} 
or 

Xj  ^Xy  \  —  x'j  ^Xj!  x'j  -F  Xj!  ^  1, 
providing  the  same  improvement  under  (5) 

max{min{0y  =  0y,0y/},max{min{0y,0y},min{0y;,0y/}}}.  (8) 

Proposition  6.  Eqs.  (7)  and  (8)  are  equivalent. 

Proof.  We  establish  the  equivalence  by  looking  at  all  partial  orderings  of  dj,  Oj,  By,  and  By.  All  partial 
orderings  must  have  Oj^By  (if  xy  becomes  zero,  then  xy  must  become  zero)  and  Bj^By  (if  xy  becomes 
one,  then  xy  must  become  one).  The  following  is  an  exhaustive  list  of  remaining  partial  orders  and  the  result 
obtained  in  both  (7)  and  (8): 
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•  yielding  Bj,, 

•  yielding  By, 

•  (lf>Gh  yielding  0^,, 

•  Bj^Bj,  Bj^Bf,  By^Bj,  By^By  yielding  By, 

•  Bj^Bj,  Bj^By,  By^Bj,  6j,^By  yielding  6j,  Bj,,  or  By 

because  Bj,  ^Bj'  ^B^j  (but  Bj,  ^Bj)  or  6j,  =  By  =  Bj, 

•  Oj^Oj,  ij>0y,  By^Bj,  By^By  yielding  Bj, 

•  Bj^Bj,  Bj^By,  By^Bj,  B^j,^By  yielding  6j,  Bj,  By,  or  By 

because  Bji  ^  8j  ^  Bj  ^  By  ^  Bji  or  Bj  =  Oj  =  By  =  Bj/ , 

•  Bj^Bj,  6j>By,  By^Bj,  6j,^By  yielding  Bj, 

•  Sy^Sj,  iy^Sy  yielding  Oj,  6j,,  Bj 
because  By  ^Bj  ^Bj  (but  Bj,  ^Bj)  so  9y  =  Bj  =  9^, 

•  Bj^Bj,  Bj^By,  6^,^6j,  By^By  yieldmg  9j,  6j,^6y,  or  By 
because  Bj  ^  6j  ^  Oj/  ^  By  ^  Bj  or  6^  =  Bj  =  By  =  Bji , 

•  Bj^Bj,  Bj^By,  6y>6j,  6j,^9y  yielding  Bj,  Bj,  Oj,,  or  By 

because  6 j  ^0j,  ^ 0y/  and  Bj  ^9j  ^  6y  (but  6 j  ^ Bj/ )  so  6j  =  Bj  =  By  =  Bj', 

•  (lj>0j,  ij^^f,  iy>0j'  yielding  Oj,  By,  or  By 

because  Bj^Bj^Bj'  (but  Bj^By)  so  Bj  =  Bj  =  Bj/, 

•  6j>6j,  0j>6y,  By^Bj,  By^By  yielding  Bj,  Bj,  By,  or  By 

because  Bj,  ^Oj/  ^Oj  and  6j,  ^Oj^Bj  (but  6j,  ^6j)  so  Bj  =  Bj  =  By  =  Bji, 

•  ij>0j,  dj>Sy,  By^Bj,  6y>9y  yielding  Bj,  Bj,  or  By 
because  6j,  ^Bj  ^Bj  (but  0^,  ^Bj)  so  9y  =  6j  =  Oj, 

•  Bj^Bj,  Bj^By,  Bj^^Bj,  By^By  yielding  (Ij,  By  By  or  By 

because  Bj^Bj'  ^Bj/  ^6j  (but  6j,  ^0^  and  Bj^Bj')  so  Oj  =  0y  =  Bj  =  Bj/, 

•  6j>0j,  Bj^By,  By^Bj,  By^By  yielding  Bj.  □ 

Consider  a  more  general  form  of  the  SVUB  constraint: 

^Xj^kxy,  (k-YVB) 

j&R' 

where  k^\R'\,  and  consider  its  equivalent  form 
Xj^xy  yjGR'.  (VUBS) 

“A:-cardinality”  constraints  such  as  these  appear  frequently  in  real-world  models. 
We  know  (7)  is  valid  for  each  j  G  R'  in  VUBS,  providing 

max{min{max{0y,  Bj, },  max{0y/,  min{0y,  0y}}}}. 

Since  Bj^Bj,,  for  all  j  G  R',  this  becomes 

max{min{0y/,  max{0;/,  min{0y,  0y  }}}} 

jeR' 


(9) 
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Table  1 


z 

Xl 

0 

X2 

0 

X3 

0 

X4 

-1 

-1 

X6 

-1 

■«1 

-1 

■«2 

-1 

■«3 

-1 

0 

RHS 

3.0 

Xl 

1 

0 

0 

1 

0 

0 

-0.5 

0.5 

-0.5 

0 

0.5 

0 

1 

0 

0 

1 

0 

-0.5 

-0.5 

0.5 

0 

0.5 

^3 

0 

0 

1 

0 

0 

1 

0.5 

-0.5 

-0.5 

0 

0.5 

54 

0 

0 

0 

1 

1 

1 

-0.5 

-0.5 

-0.5 

1 

0.5 

For  the  basic  A:-VUB  constraint, 

Xj  +  kx'j,  ^k. 

jeR'  jeR'  jeR' 

If  Xj,  =  1  (xj'  =  0),  then  ^  and  the  resulting  bound  is  vasx{9j,,6^^^}  =  9j,.  If  Xj,  =  0  (xjr  =  1)  then 

Xj  =0  or  1  Vy  G  R'  and  the  resulting  bound  is  max{0y/,maxyg^/{niin{0^,  0^}}}.  Since  xy  can  have  either 
value  0  or  1,  the  resulting  bound  (equivalent  to  (9))  is 


6.  An  illustrative  example 


Consider  a  simple  ILP 


minimize  z  =  2xi  +  2x2  +  2x3  +  3x4  +  3x5  +  3x6 
subject  to  Xi  +  X2  +  X4  +  X5  ^  1, 

X2  +X3  +X5  +X6^  1, 

Xl  +  X3  +  X4  +  X6  ^  1, 

Xl  +X2  +X3  ^  1, 

Xl,X2,X3  G  {0,  1}  X4,X5,X6^0. 


An  optimal  solution  is  xi  =  X2  =  1  with  z  =  4. 

The  explicit  simplicial  remnants  of  LP  are  given  in  Table  1.  LP  provides  a  lower  bound  on  admissible  z 
of  3. 

Using  the  information  in  Table  1,  we  compute  the  down-penalties  (e.g.,  [7,  p.  191])  0i  =02  =^3  =  0-5  and 
the  up-penalties  9i  =  §2  =  9^  =  1.  For  example,  xi  =  0.5  —  X4  -I-  O.Svi  —  0.552  +  O-Svs  so 


0[  =  min 


0.5(1)  0.5(1) 
1  ’  0.5 


=  0.5 


because  the  minimiun  penalty  for  lowering  xi  to  zero  can  be  achieved  by  either  increasing  X4  by  0.5 
(a  penalty  of  0.5(1  )/l)  or  increasing  52  by  1.0  (a  penalty  of  0.5(1  )/0.5). 


01  =  min 


0.5(1)  0.5(1) 
0.5  ’  0.5 


=  1 


because  the  minimum  penalty  for  raising  xi  to  one  can  be  achieved  by  either  increasing  5i  or  53  by  1.0 
(a  penalty  of  0.5(1  )/0.5). 
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0(CSR)  (Eq.  (2))  is  0.5.  Thus,  without  VIP  penalties,  the  lower  bound  on  admissible  z  is  3.5. 

Apply  (4)  to  the  original  1-cover  constraint  xi  +  X2  +  x^'^l  and  0(l-cover)=  1;  this  1-cover  VIP  penalty 
raises  the  lower  bound  on  z  to  4,  closing  the  integrality  gap  completely. 


7.  Implementation  and  anecdotal  compntational  experience 

We  developed  VIP  penalties  to  help  solve  real-world,  large-scale  mixed-integer  problems.  We  qualify  their 
success  with  two  caveats:  the  existing  design  of  our  solver  (the  X-system,  e.g.,  [1])  influences  our  imple¬ 
mentation,  and  our  experience  is  limited  to  problems  we  frequently  solve.  Pursuant  to  our  caveats,  we  do  not 
clutter  this  paper  with  tables  of  our  benchmarks  because  they  would  hardly  constitute  reproducible  scientific 
experiments  with  other  solvers. 

Predominantly,  we  deal  with  binary  set  partitions,  and  with  mixed-integer  logistic  network  design  problems 
(“supply  chain  models”)  with  dominant  special  structure,  such  as  embedded  networks. 

During  branch-and-bound  enumeration  of  large,  difficult  problems,  we  have  found  that  it  is  preferable  to 
make  a  considerable  investment  in  computation  before  committing  to  solve  another  linear  program.  In  this 
setting,  VIP  penalties  require  an  inconsequential  amount  of  additional  code  and  computation. 

There  are  two  sources  of  VIP  penalties:  those  based  on  existing  model  constraints,  and  those  derived  from 
valid  integer  polyhedral  constraints. 

We  constantly  monitor  restricted  simplicial  problem  structure  during  enumeration  to  identify  and  to  isolate 
candidate  rows  for  constraint-based  branching.  Thus,  identification  of  existing  restricted  source  constraints 
(e.g.,  a  1-cover  with  two  or  more  binary  variables  with  fractional  values)  is  trivial. 

We  also  seek  violated  integer  polyhedral  cuts  during  enumeration  (e.g.,  [2,5]).  Most  such  candidate  cuts 
are  of  a  form  useful  for  VIP  penalties.  The  VIP  penalty  for  a  violated  cut  offers  a  lower  bound  on  the  value 
of  the  cut  as  a  simplicial  restriction. 

VIP  penalties  are  additive  across  independent  simplicial  components  that  are  often  created  by  a  sequence 
of  restrictions  within  branch  and  bound.  We  use  breadth-first  search  to  label  and  isolate  disjoint  simplicial 
components;  VIP  penalties  are  easily  computed  and  accumulated  across  these.  Our  set  partitioning  problems 
commonly  break  into  50-100  disjoint  components  during  nontrivial  enumerations,  while  supply  chain  problems 
seldom  exhibit  more  than  five. 

VIP  penalties  are  computed  in  polynomial  time  for  ^-pack,  k-cover,  A:-partition  and  k-VUB  constraints, 
with  computational  effort  proportional  to  A:  log  A:.  Our  experiments  suggest  that  limiting  A:  to  1  minimizes 
computational  overhead  with  little  loss  in  effectiveness. 

So,  the  good  news  is  that  VIP  penalties  are  easy  to  compute.  The  bad  news  is  that  we  never  know  the 
extent  to  which  they  will  help. 

With  almost  all  models,  VIP  penalties  improve  the  lower  bound  by  a  nonzero  amount.  However,  most 
improvements  are  small  -  a  fraction  of  a  percent  reduction  in  the  integrality  gap  is  typical.  However,  if  we 
eliminate  trivial  enumeration  problems,  say,  those  that  render  the  desired  integrality  gap  within  20  branches, 
the  remaining  models  are  more  likely  to  be  improved  by  VIP. 

An  example  of  an  outlier  we  came  across  is  a  set  partition  with  1,200  rows,  36,400  binary  columns,  and  an 
average  of  50  nonzero  coefficients  per  column.  Here,  a  stubborn  residual  integrality  gap  of  18%  is  suddenly 
reduced  to  zero  by  the  sum  of  VIP  penalties  dominated  by  two  of  23  extant  disjoint  simplicial  components. 
The  consequent  fathom  soon  resolves  the  problem.  The  key  source  rows  are  a  pair  of  simple  1 -partitions  in  the 
signal  restriction,  with  the  two  dominating  penalties  each  deriving  from  the  1-cover  case  (5).  Repeating  the 
exercise  many  times,  varying  enumeration  strategy  to  suppress  various  accompanying  features  (including,  in 
particular,  integer  polyhedral  cuts),  we  find  a  number  of  similar  “VIP  events”,  but  no  discemable  explanatory 
pattern.  Across  these  experiments,  VIP  frequently  plays  a  key  role  in  resolving  an  otherwise  interminable 
enumeration. 
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Not  surprisingly,  VIP  penalties  are  more  valuable  if  not  competing  with  aggressive  generation  of  polyhedral 
cuts.  Comparatively,  the  cuts  are  more  powerful  and  reliable,  but  much  more  expensive  to  find  and  apply. 
We  have  retained  both  as  options,  suggesting  them  as  defaults  when  a  model  is  dominated  by  set-partitioning 
constraints. 

Another  significant  “VIP  evenf’  arises  in  the  Benders  master  problem  of  a  decomposed  supply-chain  model. 
The  original  master  problem  has  513  rows  and  32,110  binary  columns,  but  a  single  1-cover  (5)  isolated  in 
a  restriction  reduces  an  integrality  gap  of  8%  to  less  than  1%.  At  the  point  that  this  restriction  is  generated, 
there  are  only  two  disjoint  components,  and  no  discovered  polyhedral  cuts.  Without  VIP  penalties,  the  time 
to  resolve  this  master  problem  increases  by  an  order  of  magnitude,  and  then  another  decomposition  iteration 
of  comparable  difficulty  is  required. 

Sometimes,  you  really  want  to  close  the  integrality  gap  completely,  rather  than  just  to  some  moderate 
tolerance.  In  these  cases,  VIP  penalties  frequently  appear  to  significantly  reduce  the  exhaustive  enumeration 
effort. 

We  have  adopted  VIP  penalties  as  a  default  enumeration  feature  in  our  ILP  applications. 
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